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(54) Image projector with sensor for detecting obstacles on a projection screen 



(57) To provide a projection type image display sys- 
tem, projector, program, information storage medium 
and image projection method which can project an im- 
age applicable to viewing environment of a changed 
projection position, a liquid crystal projector is provided 
with: a sensor 60 for sensing a projection target area 
and outputting sensing information; an edge detection 
section 146 for outputting detection information based 
on the sensing information; a projectable area determi- 
nation section 144 for determining a projectable area 
based on the detection information ; a projection area se- 



lecting section 142 for selecting a projection area from 
the projectable area; a sensing data generation section 
170 for generating sensing data applicable to viewing 
environment of the selected projection area, based on 
the sensing information of the selected projection area; 
an LUT data generation section 1 60 for generating LUT 
data; a correction section 120 for correcting image in- 
formation based on the generated LUT data; and an im- 
age projection section 1 90 for projecting an image onto 
the projection area based on the corrected image infor- 
mation. 
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Description 

BACKGROUND OF THE INVENTION 

[0001] The present invention relates to a projection 
type image display system, projector, information stor- 
age medium and image projection method which can 
change a projection position. 

[0002] Projection type image display systems such as 
liquid crystal projectors and the like have been used in 
classrooms, movie theaters, meeting rooms, exhibition 
grounds and domestic living rooms. 
[0003] When an image is projected using a liquid crys- 
tal projector or the like and if there is an obstacle be- 
tween an image projecting section and a projection 
plane, the image will not well been viewed by the obsta- 
cle on which the projected light impinges or which ob- 
structs the view. 

[0004] For example, a domestic living room is usually 
used not only by the user of a liquid crystal projector or 
the like, but also by the user's family. Even if the user 
has secured any larger area of wall surface as a projec- 
tion area, anyone of his or her family may place a furni- 
ture or houseplant in front of that wall surface such that 
the furniture or houseplant will hide part of the projection 
area intended by the user. 

[0005] Moreover, if a liquid crystal projector or the like 
is used to project a product introduction image or an ad- 
vertisement image in an exhibition ground or the like, 
the image may be partially hidden behind any person 
who has unintentionally entered the projection area. 
[0006] In such a case, it is usual that the user moves 
the liquid crystal projector or the like or changes the di- 
rection of projection from the liquid crystal projector or 
the like to avoid the obstacle and to project the image 
properly However, the movement of the liquid crystal 
projector or the like is troublesome while at the same 
time, the calibration must be tried again. 
[0007] . When the liquid crystal projector or the like is 
used to project an image, moreover, the user may want 
to project the image onto the desired portion of the pro- 
jection area depending on the situation in the projection. 
[0008] For example, in a room into which a living room 
and kitchen are unified, the user may usually project an 
image onto the wall of the living room and sometimes 
want to project another image illustrating a recipe onto 
the wall of the kitchen. 

[0009] For presentation, a right-handed presenter 
may more easily point an image through a pointer when 
the image is displayed on the right side as viewed from 
audience while a left-handed presenter may more easily 
point the image through the pointer when the image is 
displayed on the left side as viewed from the audience. 
[0010] in such a case, it is preferred that the user 
shifts the image projection position to perform a more 
effective presentation. However, it takes time that the 
projector is manually adjusted in projection position and 
re-calibrated each time when one presenter is replaced 



by another. 

[0011] In order to display an image intended by the 
user, furthermore, it is necessary that the color and 
brightness of an image are corrected in consideration of 
5 the influences of ambient light (illuminating light or sun- 
light) and projection plane. 

[0012] In recent years, the partial illumination has 
been adopted even in home. If the projection position 
has been changed without change of the settings in the 
10 liquid crystal projector or the like, therefore, the image 
appearance intended by the user may highly be varied 
since the influence of the ambient light to the image is 
variable depending on the projection position. 

15 BRIEF SUMMARY OF THE INVENTION 

[0013] The present invention is made in view of the 
above-mentioned problems and may provide a projec- 
tion type image display system, projector, information 
20 storage medium and image projection method which 
can easily change projection position. 
[001 4] According to a first aspect of the present inven- 
tion, there is provided a projection type image display 
system and a projector each of which comprising: 

25 

a sensing means for sensing a projection target ar- 
ea and outputting sensing information; 
a detection means for performing edge detection or 
color-distribution detection based on the sensing in- 

30 formation and outputting detection information 
which indicates edge in a sensed image or colordis- 
tribution in a sensed image; 
a projectable area determination means for deter- 
mining a projectable area having no obstacle in the 

35 projection target area, based on the detection infor- 
mation; 

a projection area selection means for selecting a 
projection area from the projectable area, based on 
selection by a user or a predetermined criterion; 
40 an adjustment means for adjusting input image in- 
formation such that an image is displayed on the 
projection area; and 

an image projection means for projecting an image 
onto the projection area based on the adjusted input 
45 image information. 

[0015] According to a second aspect of the present 
invention, there is provided an information storage me- 
dium storing a computer-readable program which caus- 
so es a computer to function as: 

a sensing means for sensing a projection target ar- 
ea and outputting sensing information; 
a detection means for performing edge detection or 
55 color-distribution detection based on the sensing in- 
formation and outputting detection information 
which indicates edge in a sensed image or color dis- 
tribution in a sensed image; 
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a projectable area determination means for deter- 
mining a projectable area having no obstacle in the 
projection target area, based on the detection infor- 
mation; 

a projection area selection means for selecting a 5 
projection area from the projectable area, based on 
selection by a user or a predetermined criterion; 
an adjustment means for adjusting input image in- 
formation such that an image is displayed on the 
projection area; and 10 
an image projection means for projecting an image 
onto the projection area based on the adjusted input 
image information. 

[0016] According to a third aspect of the present in- 15 
vention, there is provided an image projection method 
comprising: 

sensing a projection target area to output sensing 
information; , 20 

performing edge detection or color-distribution de- 
tection based on the sensing information and out- 
putting detection information which indicates edge 
in a sensed image or color distribution in a sensed 
image; 25 
determining a projectable area having no obstacle 
in the projection target area, based on the detection 
information; 

selecting a projection area from the projectable ar- 
ea based on user selection or a predetermined cri- 30 
terion; 

adjusting input image information such that an im- 
age is displayed on the projection area; and 
projecting an image onto the projection area based 
on the adjusted input image information. 35 

[0017] In the projection type image display systems 
and the like according to the present invention, a user 
can more easily change the projection position since the 
projectable area including no obstacle (e.g., a desk, au- 40 
dience or the like) can automatically be determined. 
[0018] Each of the projection type image display sys- 
tems and projectors may further comprise: 

an image correction data generation means for gen- 45 
erating image correction data used to correct an im- 
age depending on viewing environment, based on 
the sensing information; and 
a correction means for correcting the input image 
information adjusted by the adjustment means, so 
based on the image correction data, 

wherein the image projection means projects an 
image onto the projection area based on the input image 
information corrected by the correction means. ss 
[0019] The information storage medium may further 
store a program which causes a computerto function as: 



an image correction data generation means for gen- 
erating image correction data used to correct an im- 
age depending on viewing environment, based on 
the sensing information; and 
a correction means for correcting the input image 
information adjusted by the adjustment means, 
based on the image correction data, 

wherein the image projection means projects an 
image onto the projection area based on the input image 
information corrected by the correction means. 
[0020] The image projection method may further com- 
prise: 

generating image correction data used to correct an 
image depending on viewing environment, based 
on the sensing information; 
correcting the input Image information based on the 
image correction data; and 

projecting an image onto the projection area based 
on the input image information corrected by the cor- 
rection means. 

[0021] Thus, in the projection type image display sys- 
tems and the like, an image can be corrected depending 
on viewing environment of the projection position by 
generating the image correction data based on the re- 
sult of sensing of the projection target area and using 
the image correction data to correct the input image in- 
formation. 

[0022] In each of the projection type image display 
systems, projectors and information storage medium, 
the image correction data generation means may detect 
viewing environment of the projection area and gener- 
ate the image correction data, based on the sensing in- 
formation of the projection area selected by the projec- 
tion area selection means. 

[0023] The image projection method may further com- 
prise detecting viewing environment of the projection ar- 
ea and generating the image correction data, based on 
the sensing information of the selected projection area. 
[0024] Thus, in the projection type image display sys- 
tem and the like, an image view can be kept constant 
by correcting the image depending on viewing environ- 
ment of the projection position even if the projection po- 
sition is changed. 

[0025] In each of the projection type image display 
system, projector and information storage medium, the 
image projection means may have a spatial light mod- 
ulator; and the adjustment means may associate the 
projection target area based on the sensing information 
with a pixel area of the spatial light modulator to adjust 
the input image information so that at least one of the 
position and size of an image is adjusted. 
[0026] The image projection method may further com- 
prise associating the projection target area based on the 
sensing information with a pixel area of a spatial light 
modulator adjust at least one of the position and size of 
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an image. 

[0027] Thus, in the projection type image display sys- 
tems and the like, an image can be projected with its 
appropriate size since the association of the projection 
target area with the pixel area of the spatial light modu- 
lator can automatically carried out. 
[0028] In each of the projection type image display 
systems, projectors and information storage medium, 

the sensing means may repeatedly perform the 
sensing operation at a predetermined timing and output 
the sensing information; 

the detection means may output the detection in- 
formation based on the newest sensing information; and 

the projectable area determination means may 
determine the projectable area based on the newest de- 
tection information. 

[0029] The image projection method may further com- 
prise: 

repeatedly performing the sensing operation and 
outputting the detection information at a predeter- 
mined timing; and 

determining the projectable area based on the new- 
est detection information. 

[0030] If the position or the like of an obstacle is 
changed (or if the projection area is hidden by audience, 
for example), the projection type image display systems 
and the like according to the present invention enables 
to perform automatic adjustment to project an image on 
the projection area having no obstacles by repeating the 
sensing and edge detection at a predetermined timing. 
So a user can more easily change the projection posi- 
tion. 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF 
THE DRAWING 

[0031] FIG. 1 is a schematic diagram showing a pro- 
jection area according to one embodiment of the present 
invention. 

[0032] FIG. 2 is a functional block diagram showing a 
projection type image display system in a liquid crystal 
projector according to one embodiment of the present 
invention. 

[0033] FIG. 3 is a flow chart showing an image pro- 
jecting procedure according to one embodiment of the 
present invention. 

[0034] FIG. 4 is a hardware block diagram showing a 
projection type image display system in a liquid crystal 
projector according to one embodiment of the present 
invention. 

[0035] FIG. 5 is a functional block diagram showing 
another projection type image display system in a liquid 
crystal projector according to one embodiment of the 
present invention. 



DETAILED DESCRIPTION OF THE EMBODIMENT 

[0036] The present invention applied to a projection 
type image display system that uses a liquid crystal pro- 

5 jector is described below by way of example, with refer- 
ence to the accompanying drawings. Note that the em- 
bodiment described below do not in any way limit the 
scope of the present invention defined by the claims laid 
out herein. Similarly, ail the elements of the embodiment 

10 below should not be taken as essential requirements de- 
fined by the claims herein. 

System configuration 

is [0037] There will be described a case when a liquid 
crystal projector is arranged in a domestic living room 
to project an image onto the wall. 
[0038] FIG. 1 is a schematic diagram showing a pro- 
jection area according to one embodiment of the present 

20 invention. 

[0039] When the wall is used as a projection target 
area 1 0 onto which an image is projected and if any ob- 
stacle such as a picture 20, a foliage plant 22 or the like, 
the wall may be hidden behind the obstacle. Thus, the 

25 liquid crystal projector may not adequately display an 
image. 

[0040] In particular, because the living room is used 
by a plurality of members in the family, the picture 20 
and/or foliage plant 22 may frequently be moved by any 

so of the members. It is therefore difficult to secure the pro- 
jection area adequately at all times. 
[0041] Moreover, the image appearance is variable 
depending on the position of a fluorescent lamp 50. In 
recent years, the partial illumination has taken in home. 

35 The image appearance is variable depending on the po- 
sition onto which the liquid crystal projector projects an 
image in the living room. 

[0042] The liquid crystal projector according to this 
embodiment senses the projection target area 10 

40 through a CCD sensor for performing edge detection, 
determines a plurality of projection areas 40-1 to 40-3 
which satisfy a predetermined aspect ratio and decides 
one of the projection areas 40 on selection of the user 
to project an image thereonto. 

45 [0043] Furthermore, the liquid crystal projector ac- 
cording to this embodiment realizes an ideal image ap- 
pearance by correcting the color and brightness of the 
image in consideration of the influence of an ambient 
light (an illuminating light from the fluorescent lamp 50 

so orsunlight) in a viewing environment (or an environment 
under which the image is actually viewed under the in- 
fluence of the light from the fluorescent lamp 50 as well 
as the influence of the color in the projection area) and 
the influence of the projection plane (such as the color 

55 of the projection area, spectral reflection factor and the 
like). 

[0044] Thus, the user can reproduce an ideal image 
appearance even if the image projection position has 
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been changed. 
Functional blocks 

[0045] Functional blocks in a projection type image 
display system included in a liquid crystal projector for 
realizing the aforementioned functions will be described 
below. 

[0046] FIG. 2 is a functional block diagram showing a 
projection type image display system in a liquid crystal 
projector according to one embodiment of the present 
invention. 

[0047] The projection type image display system 
comprises a sensor 60, an input signal processing sec- 
tion 11 0, a correction section 1 20, a D/A converter sec- 
tion 180, an image projection section 190, a projection- 
area-to pixel area association section 130, a projection 
area determination section 1 40, a calibration signal gen- 
eration section 150, a sensing data generating section 
1 70, an LUT data generation section 1 60 and an aspect- 
ratio determination section 132. 

[0048] The input signal processing section 110 con- 
verts R1 -, G1 - and B1 -signals constituting analog R-, G- 
and B-signals which are a kind of input image informa- 
tion from PC (Personal Computer) or the like into digital 
R2-, G2- and B2-signals. 

[0049] The input signal processing section 110 com- 
prises an A/D converter section 1 1 2 for performing such 
an analog to digital conversion and an image position/ 
size adjustment section 114 which is part of an adjust- 
ment mean for adjusting the position and size of the im- 
age (which may adjust only the position or size of the 
image). 

[0050] However, the A/D converter section 1 1 2 and D/ 
A converter section 1 80 are unnecessary if only digital 
type R-, G- and B-signals are used in the projection type 
image display system. 

[0051] The calibration signal generation section 150 
generates digital R2-, G2- and B2-signals used for pro- 
jection of calibration images. 

[0052] In such a manner the calibration can be made 
solely by the liquid crystal projector by internally gener- 
ating calibration signals within the liquid crystal projector 
without inputting calibration signals from any external in- 
put device such as a PC or the like into liquid crystal 
projector. The calibration image signals may be inputted 
from PC or the like directly into the projector 20 without 
provision of the calibration signal generation section 
150. 

[0053] The correction section 120 comprises a 
3D-LUT (three-dimensional lookup table) storage sec- 
tion 122 and a 1D-LUT (one-dimensional lookup table) 
storage section 1 24. The correction section 1 20 corrects 
the color of an image using 3D-LUT and the brightness 
of the image using 1D-LUT 3D-LUT and 1D-LUT are 
kinds of image correction data. The image correction da- 
ta may be in the form of a matrix, for example. 
[0054] The correction section 1 20 corrects the color, 



brightness and the like of the image to form output R3-, 
G3- and B3-signals, based on the R2-. G2- and B2-sig- 
nalsfrom the input signal processing section 110 or the 
calibration signal generation section 150. 

5 [0055] The D/A converter section 1 80 converts the 
R3-, G3- and B3-signals from the correction section 1 20 
into analog R4-, G4- and B4-signals. 
[0056] The image projection section 1 90 comprises a 
drive section 191, a spatial light modulator 192 and a 

10 source of light 1 93 and a lens 1 95. 

[0057] The drive section 191 drives the spatial light 
modulator 192 based on the R4-, G4- and B4-signals 
from the D/A converter section 1 80. The image projec- 
tion section 190 projects the light from the light source 

15 193 through the spatial light modulator 192 and lens 
195. 

[0058] In this embodiment, furthermore, the projec- 
tion area decision region 140 Included In the liquid crys- 
tal projector comprises a projection area selecting sec- 
20 tion 142, a projectable area determination section 144, 
an edge detection section 146 and a projection-range 
detection section 148. 

[0059] The projection -range detection section 1 48 de- 
tects the range of the projection target area 10 (which 

25 wili also be referred to the projection range 1 0A), based 
on sensing information represented by X-, Y- and Z-val- 
ues (tristimulus values of XY2) from the sensor 60 which 
is a sensing means for sensing the projection target area 
10. The X-, Y- and Z-values used herein are machinery 

30 independence colors which are based on the Interna- 
tional Standard defined by the International Commis- 
sion on Illumination (CIE). 

[0060] For convenience, FIG. 1 shows the projection 
target area 1 0 which has the same size as the projection 

35 range 10A. Moreover, the projection range 10A is in- 
tended to indicate the range in the projection target area 
10 irradiated by a projection light. 
[0061] The edge detection section 146 performs the 
edge detection and outputs detection information, 

40 based on the X-, Y- and Z-values of the whole projection 
range 10A on the projection target area 10. 
[0062] The projectable area determination section 
144 determines projection areas 40-1 to 40-3 which 
have no obstacle such as picture 10 or the like within 

45 the projection range 10A on the projection target area 
10 and also which have a size equal to or larger than a 
fixed size satisfying the aspect ratio, based on the de- 
tection information and an aspect ratio determined by 
the aspect- ratio determination section 132 (for example, 

50 16:9, 4:3 or the like). For simplicity, FIG. 1 shows three 
representative projection areas 40-1 to 40-3, but more 
projection areas 40 can actually be determined. More- 
over, only one projection area may be determined. The 
projectable area determination section 144 detects a 

55 portion of the projection area surrounded by a boarder 
line on the outermost side thereof as a projectable area 
30. 

[0063] If there is any projection area which does not 
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overlap with other projection areas, a plurality of project- 
able areas 30 may be detected. 
[0064] The projection area selecting section 142 se- 
lects one of the projection areas 40-1 to 40-3 contained 
in the projectable area 30 according to user's instruction 
of selection (e.g., through a remote controller in the liq- 
uid crystal projector). 

[0065] The projection-area-to-pixel area association 
section 130, which is part of the adjusting means, asso- 
ciates the projection area in the projection range 1 0A on 
the projection target area 10 with the pixel area of the 
spatial light modulator 192, based on the projection 
range 10A on the projection target area 10 detected by 
the projection-range detection section 148 and the pro- 
jection area selected by the projection area selecting 
section 142. More particularly, the projection -area-to- 
pixel area association section 1 30 determines a ratio be- 
tween the projection range 1 0A on the projection target 
area 1 0 and the pixel area of the spatial light modulator 
192. 

[0066] In place of this technique, the p reject ion-area- 
to-pixei area association section 130 may associates 
coordinates within the projection range 10A (or coordi- 
nates on a light-receiving element in the sensor 60) with 
coordinates on the projected image (or calibration im- 
age). This is because the coordinates on the projected 
image can be transformed into coordinates on the pixel 
area of the spatial light modulator 1 92 through a prede- 
termined transformation. 

[0067] The relationship between a pixel in the project- 
ed image and a pixel portion of the spatial light modula- 
tor 1 92 has been known by the image projection section 
190. 

[0068] The image position/size adjustment section 
114 adjusts the input image information to regulate the 
position and size of the image, based on the ratio deter- 
mined by the projection-area-to-pixel area association 
section 130 and the positional information in the projec- 
tion range 10A on the projection target "area 10 in the 
projection area selected by the projection area selecting 
section 142. 

[0069] Furthermore, the liquid crystal projector ac- 
cording to this embodiment comprises a sensing data 
generation section 170 for computing the mean value in 
the projection area from X-, Y- and Z-values for each 
pixel from the sensor 60 when a plurality of calibration 
images are projected, to correct the influence of the am- 
bient light, and an LUT data generation section 160 for 
updating or generating 3D-LUT stored in the 3D-LUT 
storage section 122 and 1D-LUT stored in the 1D-LUT 
storage section 124, based on X-, Y- and Z-values for 
each calibration image. 

[0070] The sensing data generation section 1 70 com- 
putes the mean value of X-, Y-and Z-values of pixels in 
the projection area, based on the sensing information 
from the sensor 60 and information indicating the pro- 
jection area from the projection area determination sec- 
tion 140. 



[0071] The LUT data generation section 160, which is 
an image correction data generating means, then gen- 
erates 3D-LUT and 1 D-LUT based on the computed 
mean value. The LUT data generation section 160 may 

s generate the image correction data corresponding to a 
device using a device profile which has been held in the 
LUT data generation section 160. 
[0072] In such a manner, the image information can 
be corrected depending on the viewing environment in 

10 the projection area by generating the image correction 
data based on the mean value of the Y- and Z-values 
which is sensing information for each of the pixels form- 
ing the projection area. 

15 Flow of image processing 

[0073] A flow of image processing with the use of 
these sections and portions will now be described In 
connection with a flow chart. 
20 [0074] FIG. 3 is a flow chart showing an image pro- 
jecting procedure according to one embodiment of the 
present invention. 

[0075] First of all, the calibration signal generation 
section 150 produces calibration signals so that a plu- 

25 rality of single-colored calibration images (for example, 
white-, red-, green-, blue-, gray- and black-colored cal- 
ibration images) will be displayed; the correction section 
1 20 corrects color temperature and the like on the basis 
of normal liquid crystal projector settings; and the image 

30 projection section 1 90 sequentially projects the calibra- 
tion images based on the corrected image information. 
[0076] The sensor 60 measures X-, Y- and Z-values 
of each pixel (or a pixel in sensor 60 used to output the 
calibration image measurement through the sensor 60) 

55 jn outputs measured value of the calibration image) in 
a calibration image displayed on the projection target 
area 10 (step S1). 

[0077] The projection-range detection section 148 
then detects the projection range 10, based on the dif- 

40 ference for each pixel between X-, Y- and Z-values when 
the white-colored calibration image is displayed and X-, 
Y- and Z-values when the black-colored calibration im- 
age is displayed (step S2). In this case, it is preferably 
assumed, for example, that pixels having the difference 

45 equal to or more than 5 cd/m 2 are included In the pro- 
jection range 10A on the projection target area 10. In 
place of the sensing information (X-, Y- and Z-values) 
when the black-colored calibration image is displayed, 
the sensing information in the projection range 10A on 

50 the projection target area 1 0 when the black-colored cal- 
ibration image is not displayed may be used. 
[0078] The edge detection section 146 performs the 
edge detection, based on the X-, Y- and Z-values meas- 
ured when the black-colored calibration image is dis- 

55 played (step S3). More particularly, the edge detection 
section 146 is based on the X-, Y- and Z-values of the 
pixel in the projection range 10A detected by the projec- 
tion-range detection section 148. 
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[0079] The projectable area determination section 
1 44 then determines a projectable area 30 (i.e., an area 
including at least one projection area), based on the im- 
age aspect ratio from the aspect-ratio determination 
section 1 32 and the edge detection data from the edge 
detection section 146. More particularly, the projectable 
area determination section 1 44 detects the edge detec- 
tion data in the projection range 10A from its left and 
upper location to its right and lower location to specify 
an area which satisfies a desired aspect ratio (i.e., one 
projection area). For example, if there is a polygon- 
shaped projectable area 30 as shown in FIG. 1, a plu- 
rality of projection areas 40-1 to 40-3 will be selected 
(step S4). 

[0080] The projection area determination section 1 40 
outputs information indicative of these projection areas 
40-1 to 40-3 selected by the projectable area determi- 
nation section 144 toward the input signal processing 
section 110; and the image projection section 190 
projects a selecting image for causing a user to select 
one of the projection areas 40-1 to 40-3. In this case, 
the input signal processing section 1 1 0 may have stored 
image information used to generate the selecting image. 
[0081] The projection area selecting section 1 42 then 
selects one of the projection areas 40-1 to 40-3, based 
on a predetermined criterion (for example, it is at the 
upper end, lower end, left end or right end) or a user's 
instruction (step S5). 

[0082] The sensing data generation section 1 70 com- 
putes the mean value of X-, Y- and Z-values of each of 
the pixels forming the projection area in each calibration 
image, based on the sensing information from the sen- 
sor 60 and information indicating the projection area 
from the projection area determination section 140. 
Moreover, the LUT generating section 160 generates 
3D-LUT and 1 D-LUT based on the computed mean val- 
ue (step S6) and updates the LUT data by storing them 
in the 3D-LUT and 1 D-LUT storage sections 122, 124, 
respectively (step S7). 

[0083] The projection-area-to-pixel area association 
section 130 then associates the projection area with the 
pixel area of the spatial light modulator 192 (step S8). 
In this case, the image may be resized so that the entire 
range of the image represented by the image signals is 
projected onto the selected projection area. Alternative- 
ly, the image may be trimmed so that part of the image 
represented by the image signals is projected onto the 
selected projection area. 

[0084] The image position/size adjustment section 
1 1 4 then uses this association to adjust the digitally con- 
verted input image signals so that the position and size 
of the image will be adjusted and outputs digital signals 
(R2, G2 ; B2). 

[0085] Furthermore, the correction section 120 uses 
these digital signals (R2, G2, B2) to correct the image 
information so that the image takes the color and bright- 
ness corresponding to the viewing environment on the 
projection area; and the D/A converter section 1 80 per- 



forms the digital conversion against the image informa- 
tion (R3, G3, B3) from the correction section 120 and 
outputs analog signals (R4, G4, B4). 
[0086] The drive section 191 then drives the spatial 

5 light modulator 1 92 based on these analog signals (R4, 
G4, B4); and the image projection section 1 90 outputs 
a light from the light source 1 93 through the spatial light 
modulator 192 and lens 195 to project the image. 
[0087] In such a manner, the image projection section 

io 1 90 can project the image corrected relating to its color 
and brightness onto the projection area (step S9). 
[0088] As described, this embodiment can permit the 
user to change the projection position in a more simple 
and easy manner since the liquid crystal projector can 

*5 automatically determine any suitable projectable area 
30 on which there is no obstacle (for example, desk, au- 
dience or the like). 

[0089] For presentation, a right-handed presenter 
may more easily point an image through a pointer when 
zo the image is displayed on the right side as viewed from 
audience while a left-handed presenter may more easily 
point the image through the pointer when the image is 
displayed on the left side as viewed from the audience. 
[0090] Even in such a case, this embodiment permits 
25 the user to project the image onto any preferred position 
without need of any manual adjustment for the projec- 
tor's projection position. 

[0091] According to this embodiment, furthermore, 
the liquid crystal projector can project the image after 
30 the color and brightness thereof have been corrected 
for the viewing environment of the projection area se- 
lected from the projectable area by generating the sens- 
ing data from the computed mean values of the X-, Y- 
and Z-values of each of the pixels forming the projection 
35 area in each calibration image, based on the sensing 
information from the sensor 60 and the information in- 
dicative of the projection area from the projection area 
determination section 140 and by using the image cor- 
rection data generated based on this sensing data. 
40 [0092] Thus, the liquid crystal projector can more sim- 
ply and easily change the projection position, for exam- 
ple, even if the projection area 40 is continuously 
changed for display, since no calibration must be re-tried 
each time when the projection area is change. 
45 [0093] According to this embodiment, furthermore, 
the liquid crystal projector can project the image with its 
appropriate size onto an appropriate position since the 
association of the projection range 1 0A on the projection 
target area 1 0 with the pixel area in the spatial light mod- 
50 ulator 192 can automatically be carried out. 

Hardware configuration 

[0094] For example, the following things can be ap- 
55 plied to the respective hardware parts above mentioned. 
[0095] FIG. 4 is a hardware block diagram showing a 
projection type image display system in a liquid crystal 
projector according to one embodiment of the present 
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Invention. 

[0096] For example, the A/D converter section 112 
may be implemented by an A/D converter 930 or the 
like; the D/A converter section 1 80 may be implemented 
by a D/A converter 940 or the like; the drive section 1 91 
may be implemented by a ROM 960 or the like stored a 
liquid crystal light valve drive driver; the spatial light 
modulator 192 may be implemented by a liquid crystal 
panel 920 or a liquid crystal light valve or the like; the 
correction section 120, projection area selecting section 
142, projectable area determination section 144, edge 
detection section 146, projection-range detection sec- 
tion 148, projection-area-to-pixel area association sec- 
tion 130, aspect-ratio determination section 132, sens- 
ing data generation section 1 70 or LUT generating sec- 
tion 160 may be implemented by an image processing 
circuit 970 or CPU 91 0 or the like; the calibration signal 
generation section 150 may be implemented by a RAM 
950 or the like; and the sensor 60 may be implemented 
by a multi-pixel sensor which can derive X-, Y- and Z- 
values such as a CCD sensor or a CMOS sensor or the 
like. These components are configured to mutually de- 
liver the information therebetween through a system bus 
980. Moreover, these components could be implement- 
ed in a hardware manner such as circuits or in a software 
manner such as drivers. 

[0097] In addition, these functions could be imple- 
mented by a computer within the liquid-crystal projector 
reading out a program from an information storage me- 
dium 300. 

[0098] The information storage medium 300 could be 
a CD-ROM, DVD-ROM, ROM, RAM, or HDD, by way of 
example, and the method of reading the program there- 
from could be a direct method or an indirect method. 
[0099] Instead of the Information storage medium 
300, it is also possible to download a program that im- 
plements the above-described functions, from a host 
device over a network, in order to implement the above- 
described functions. 

Modifications 

[0100] Although one embodiment of the present in- 
vention has been described, the present invention is not 
limited to this embodiment. 

[0101] For example, the projectable area determina- 
tion section 144 determines the projectable area 30 
based on the edge detection information in a sensed im- 
age from the edge detecting section 146 in the above 
embodiment, but the projectable area 30 may be deter- 
mined based on information other than the edge detec- 
tion information. The projectable area determination 
section 144 may determine the projectable area 30 
based on color distribution in a sensed image, 
[0102] Since the X-, Y- and Z-values relating to an ob- 
stacle such as the foliage plant 22 are different from the 
X-, Y- and Z-values in the projectable area 30 in the 
sensed image of FIG. 1 , the projectable area 30 can be 



selected by detecting distribution of X-, Y- and Z-values 
representing colors. The technique of selecting the pro- 
jectable area 30 based on color distribution will be de- 
scribed below. 

5 [0103] FIG. 5 is a functional block diagram of a pro- 
jection type image display system In a liquid crystal pro- 
jector according to one embodiment of the present in- 
vention. 

[01 04] In this embodiment, the edge detecting section 
10 1 46 is replaced by a color-distribution detection section 
147 which outputs detection information indicating color 
distribution in a sensed image (which may be the whole 
or part of the sensed image) from the sensor 60, and 
the projectable area determination section 144 is re- 
*5 placed by a projectable area determination section 1 45. 
[0105] After the processing in the project region de- 
tection section 148 (step S2) described in connection 
with Fig. 3, the color-distribution detection section 147 
detects color distribution in the project region 1 0A based 
20 on the sensing information (X-, Y- and Z-values) relating 
to a portion corresponding to the project region 10A in 
the sensed image. 

[0106] More particularly, the color-distribution detec- 
tion section 147 generates a histogram (or frequency 
25 distribution) of X-, Y- and Z-values for a predetermined 
image processing unit (such as one pixel or a pixel block 
including a fixed number of pixels in horizontal and ver- 
tical directions). 

[0107] The color-distribution detection section 147 

30 then detects a range of X-value (XP1 -XP2) having upper 
frequency in the histogram of X value. Similarly, the 
color-distribution detection section 147 detects a range 
of Y-value (YP1-YP2) having upper frequency and a 
range of Z-value (ZP1-ZP2) having upper frequency. 

35 These ranges are optional, so they may be identical with 
one another or different from one another. 
[0108] The color-distribution detection section 147 
outputs the color-distribution information (XP1-XP2, 
YP1 -YP2 and ZP1 -ZP2) toward the projectable area de- 

40 termination section 145. 

[0109] The projectable area determination section 
145 then determines the projectable area 30, based on 
an aspect ratio of an image from the aspect ratio deter- 
mination section 132 and the detection information of 

^5 color distribution from the color-distribution detection 
section 147. 

[0110] Specifically, the projectable area determina- 
tion section 145 selects an area AX having an X-value 
corresponding to the range of X-value (XP1-XP2) from 

50 the color-distribution detection section 147, based on 
the sensing information relating to the projection area 
10A in the sensed image. Note that the sensing infor- 
mation has an ordinate position, an abscissa position, 
X-value, Y-value and Z-value for each coordinate posi- 

55 tion. Therefore, the projectable area determination sec- 
tion 145 can use the X-value as a search key to detect 
the ordinate and abscissa positions in the coordinates 
having the X-value, so that it can select the area AX. 
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Areas AY and AZ for Y- and Z-values can be selected 
similarly. 

[01 1 1 ] According to such a procedure, the projectable 
area determination section 1 45 selects the area AX hav- 
ing the X-value in the range of X-value (XP1 -XP2), the 5 
area AY having the Y-value in the range of X-value 
(YP1-YP2) and the area AZ having the Z-value in the 
range of Z-value (ZP1 -ZP2) in addition to an area AA in 
which the areas AX, AY and AZ overlap each other (e. 
g., the projectable area 30 in Fig. 1). 
[01 12] In such a manner, the projectable area 30 can 
be selected. The remaining procedure portion may be 
accomplished by the steps after the above-mentioned 
step S3 in FIG. 3. 

[01 1 3] By using such a technique based on the color 
distribution, the liquid crystal projector according to this 
embodiment can select an area satisfying the aspect ra- 
tio from among an area which has the same color and 
is not been influenced (or influenced) by the environ- 
ment, as a projection area, even if part of the projection 
target area 1 0 has been influenced by that environment 
(due to the fluorescent lamp 50 or the like). 
[0114] The liquid crystal projector according to this 
embodiment can perform the processing more quickly 
(or more efficiently) since the edge detection can be 
omitted by adopting the technique based on the color 
distribution. 

[01 15] Note that the technique of detecting color dis- 
tribution is not limited to the aforementioned technique. 
For example, the range of X-, Y- or Z-value may be de- 
termined by calculating these values with different co- 
efficient values or by using a certain function. Moreover, 
the indexes for detecting color distribution may be in the 
form of R-, G- and B-values, other than the X-, Y- and 
Z-values. 

[0116] When part of the projection target area 10 re- 
flects no light projected from the liquid crystal projector, 
such as when the liquid crystal projector is used out- 
doors and part of the projection target area 1 0 is an emp- 
ty space, or when the liquid crystal projector is used in 
a classroom and part of the projection target area 10 is 
a glass window, the liquid crystal projector may perform 
the following processing. 

[0117] When the liquidcrystal projector projects a rec- 
tangular image, the projection area can be determined 
by a process in which projecting and imaging of points 
or lines representing four corners of the rectangular im- 
age is repeatedly performed while narrowing the projec- 
tion range, and the four corners in the sensed image is 
associated with the coordinates of the four comers in 
the spatial light modulator 192 at the point of detection 
of the points or lines representing the four comers by 
the sensor 60. 

[0118] Although the liquid crystal projector in the 
above embodiment uses a monochromatic black cali- 
bration image for the edge detection or other process- 
ing, sensing information indicating differences between 
the X-, Y- and Z-values of a monochromatic white cali- 



bration image as a sensed image and the X-, Y- and Z- 
values of a monochromatic black calibration image as 
a sensed image may be used for the edge detection or 
other processing. 

[0119] Even if the projection target area 10 is influ- 
enced by the environment differently by location, the liq- 
uid crystal projector can perform the detection of color 
distribution and the like in a state the difference is re- 
duced. 

[01 20] The user's selection of the projection area may 
be carried out through a button or remote controller on 
the main body of the liquid crystal projector or through 
action or voice of the user. 

[01 21 ] Moreover, the liquid crystal projector according 
to this embodiment may perform the trapezoid skew cor- 
rection or automatic focus adjustment when the image 
is projected. 

[0122] Furthermore, the projection area may have 
any configuration other than the rectangle-shaped con- 
figuration as in the aforementioned embodiment, such 
as a circular configuration. 

[0123] In addition, the liquid crystal projector of this 
embodiment may repeatedly perform such an image 
projection as shown in FIG. 9 at a predetermined timing 
(e.g., with a predetermined time interval or at a time 
point when one presenter is replaced by another). 
[01 24] Thus, the liquid crystal projector can automat- 
ically perform such an adjustment that the image can be 
projected onto a projection area having no obstacle by 
repeating the sensing and edge detection operations at 
a predetermined timing when the position of an obstacle 
has been changed, more particularly, when the projec- 
tion area is hidden by audience. Thus, the user can more 
simply and easily change the projection position. The 
liquid crystal projector may further determine the projec- 
tion area depending on the position of the obstacle. 
[0125] In addition, the liquid crystal projector of this 
embodiment may repeat such a process as shown by 
steps S1 to S9 in FIG. 3 if the image processing of FIG. 
3 is repeated at the predetermined timing. Alternatively, 
the liquid crystal projector may repeat such a process 
as shown by steps S3 to S9 by performing only the sens- 
ing operation for the projection target area 1 0 on non- 
display (or the projected black-colored calibration im- 
age) at step 1 and omitting the procedure of step S2. 
[0126] In the former case, thus, the liquid crystal pro- 
jector can not only perform such an adjustment that the 
image is projected onto a projecting area 40 having no 
obstacle, for example, when a new obstacle enters the 
projection area, but also project the image after it has 
been corrected for a new viewing environment when the 
older viewing environment has been changed. In the lat- 
ter case, the liquid crystal projector can more simply and 
easily change the projection position without giving trou- 
blesome feelings to observers due to display of the 
colored calibration images, since the image can be pro- 
jected onto the new projection area having no obstacle 
merely by performing the sensing operation for the prO- 
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jection target area 1 0 on non-display. 
[0127] Although the preferred embodiment has been 
described as to the liquid crystal projector which deter- 
mine the maximum projectable area 30 after one or 
more projection areas 40 satisfying the aspect ratio 
have been selected, one or more projection areas 40 
satisfying the aspect ratio within the projectable area 30 
may be selected after the projectable area 30 having no 
obstacle has been determined based on the edge de- 
tection data. 

[0128] Although the preferred embodiment has been 
described as to the liquid crystal projector which gener- 
ates the image correction data based on the mean value 
of X-, Y- andZ-values on the projection area determined 
by the projection area determination section 140, image 
correction data (e.g., 3D-LUT, 1D-LUT and the like) 
may be generated based on the mean value of the X-, 
Y- and Z-values for each selectable projection area (for 
example, each of the projection areas 40-1 to 40-3 
shown in FIG. 1). It may be then stored to correction 
section 120. The input image information may be then 
corrected while switching one changing image correc- 
tion data to be applied to another, depending on selec- 
tion of the projection area. 

[0129] Thus, the liquid crystal projector can apply the 
image correction data acceptable to the viewing envi- 
ronment within a reduced time period since it is not re- 
quired to update the image correction data at each time 
when the projection area is changed, even though it is 
frequently changed. 

[0130] The projection type image displaying system 
according to this embodiment may be applied to any one 
of various projectors such as a projector using a digital 
micromirror device (DMD) and the like, other than the 
aforementioned liquid crystal projector. For example, 
the aforementioned spatial light modulator may be in the 
form of an instrument consisting of a DMD tip and a color 
filter. By the way, DMD is a trademark possessed by the 
U. S. Texas Instruments. In addition, the projector is not 
limited to be of front projection type, but it may be of 
back projection type. 

[0131] The present invention can effectively be used 
even when an image is projected in the business such 
as a meeting room, a medical building-site, an adver- 
tisement spot, an education spot, a movie theater, an 
exhibition ground, rather than for the aforementioned 
domestic living rooms. 

[0132] In addition, the aforementioned function of the 
projector type image displaying system may be imple- 
mented by a single liquid crystal projector or by a plu- 
rality of distributed processing devices (e.g., a liquid 
crystal projector and personal computers). 



Claims 

1 . A projection type image display system comprising: 



a sensing means for sensing a projection target 
area and outputting sensing information; 
a detection means for performing edge detec- 
tion or color-distribution detection based on the 

5 sensing information and outputting detection 

information which indicates edge in a sensed 
image or color distribution in a sensed image; 
a projectable area determination means for de- 
termining a projectable area having no obstacle 

10 in the projection target area, based on the de- 

tection information; 

a projection area selection means for selecting 
a projection area from the projectable area, 
based on selection by a user or a predeter- 

15 mined criterion; 

an adjustment means for adjusting input image 
information such that an image is displayed on 
the projection area; and 
an image projection means for projecting an im- 

20 age onto the projection area based on the ad- 

justed input image information. 

2. The projection type image display system as de- 
fined in claim 1, further comprising: 

25 

an image correction data generation means for 
generating image correction data used to cor- 
rect an image depending on viewing environ- 
ment, based on the sensing information; and 
30 a correction means for correcting the input im- 

age information adjusted by the adjustment 
means, based on the image correction data, 

wherein the image projection means projects 
35 an image onto the projection area based on the in- 
put image information corrected by the correction 
means. 

3. The projection type image display system as de- 
40 fined in claim 2, 

wherein the image correction data generation 
means detects viewing environment of the projec- 
tion area and generates the image correction data, 
based on the sensing information of the projection 
45 area selected by the projection area selection 
means. 

4. The projection type image display system as de- 
fined in any one of claims 1 to 3, wherein: 

so 

the image projection means has a spatial light 
modulator; and 

the adjustment means associates the projec- 
tion target area based on the sensing informa- 
55 tion with a pixel area of the spatial light modu- 

lator to adjust the input image information so 
that at least one of the position and size of an 
image is adjusted. 
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5. The projection type image display system as de- 
fined in claim 4, wherein: 

the sensing means repeatedly performs the 
sensing operation at a predetermined timing 5 
and outputs the sensing information; 
the detection means outputs the detection in- 
formation based on the newest sensing infor- 
mation; and 

the projectable area determination means de- 10 
termines the projectable area based on the 
newest detection information. 

6. A projector comprising: 

15 

a sensing means which senses a projection tar- 
get area and outputs sensing information; 
a detection means which performs edge detec- 
tion or co I or- distribution detection based on the 
sensing information and outputs detection in- 20 
formation which indicates edge in a sensed im- 
age or color distribution in a sensed image; 
a projectable area determination means which 
determines a projectable area having no obsta- 
cle in the projection target area, based on the 25 
detection information; 

a projection area selection means which se- 
lects a projection area from the projectable ar- 
ea, based on selection by a user or a predeter- 
mined criterion; 30 
an adjustment means which adjusts input im- 
age information such that an image is displayed 
on the projection area; and 
an image projection means which projects an 
image onto the projection area based on the ad- 35 
justed input image information. 

7. An information storage medium storing a computer- 
readable program which causes a cornputer to func- 
tion as: 40 

a sensing means for sensing a projection target 
area and outputting sensing information; 
a detection means for performing edge detec- 
tion or color-distribution detection based on the 45 
sensing information and outputting detection 
information which indicates edge in a sensed 
image or color distribution in a sensed image; 
a projectable area determination means for de- 
termining a projectable area having no obstacle so 
in the projection target area, based on the de- 
tection information; 

a projection area selection means for selecting 
a projection area from the projectable area, 
based on selection by a user or a predeter- 55 
mined criterion; 

an adjustment means for adjusting input image 
information such that an image is displayed on 



the projection area; and 
an image projection means for projecting an im- 
age onto the projection area based on the ad- 
justed input image information. 

8. The information storage medium as defined in claim 
7, further storing a program which causes a com- 
puter to function as: 

an image correction data generation means for 
generating image correction data used to cor- 
rect an image depending on viewing environ- 
ment, based on the sensing information; and 
a correction means for correcting the input im- 
age information adjusted by the adjustment 
means, based on the image correction data, 

wherein the image projection means projects 
an image onto the projection area based on the in- 
put image information corrected by the correction 
means. 

9. The information storage medium as defined in claim 
8, 

wherein the image correction data generation 
means detects viewing environment of the projec- 
tion area and generates the image correction data, 
based on the sensing information of the projection 
area selected by the projection area selection 
means. 

10. The information storage medium as defined in any 
one of claims 7 to 9, wherein: 

the image projection means has a spatial light 
modulator; and 

the adjustment means associates the projec- 
tion target area based on the sensing informa- 
tion with a pixel area of the spatial light modu- 
lator to adjust the input image information so 
that at least one of the position and size of an 
image is adjusted. 

1 1 . The information storage medium as defined in claim 
10, wherein: 

the sensing means repeatedly performs the 
sensing operation at a predetermined timing 
and outputs the sensing information; 
the detection means outputs the detection in- 
formation based on the newest sensing infor- 
mation; and 

the projectable area determination means de- 
termines the projectable area based on the 
newest detection information. 

12. An image projection method comprising: 
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sensing a projection target area to output sens- 
ing information; 

performing edge detection or color-distribution 
detection based on the sensing information and 
outputting detection information which indi- 5 
cates edge in a sensed image or color distribu- 
tion in a sensed image; 
determining a projectable area having no ob- 
stacle in the projection target area, based on 
the detection information; 10 
selecting a projection area from the projectable 
area based on user selection or a predeter- 
mined criterion; 

adjusting input image information such that an 
image is displayed on the projection area; and 15 
projecting an image onto the projection area 
based on the adjusted Input image information. 

13. The image projection method as defined in claim 

12, further comprising: 20 

generating image correction data used to cor- 
rect an image depending on viewing environ- 
ment, based on the sensing information; 
correcting the input image information based 25 
on the image correction data; and 
projecting an image onto the projection area 
based on the input image information corrected 
by the correction means. 

30 

14. The image projection method as defined as defined 
in claim 1 3, further comprising: 

detecting viewing environment of the projection 
area and generating the image correction data, 35 
based on the sensing information of the select- 
ed projection area. 

15. The image projection method as defined in any one 

of claims 12 to 14, further comprising: 40 

associating the projection target area based on 
the sensing information with a pixel area of a 
spatial light modulator to adjust at least one of 
the position and size of an image. 45 

16. The image projection method as defined in claim 
15, further comprising: 

repeatedly performing the sensing operation 50 
and outputting the detection information at a 
predetermined timing; and 
determining the projectable area based on the 
newest detection information. 
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